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ABSTRACT 

We design optimal 2 x N (2 < TV) matrices, with unit 
columns, so that the maximum condition number of all the 
submatrices comprising 3 columns is minimized. The prob- 
lem has two applications. When estimating a 2-dimensional 
signal by using only three of N observations at a given time, 
this minimizes the worst-case achievable estimation error. It 
also captures the problem of optimum sensor placement for 
monitoring a source located in a plane, when only a minimum 
number of required sensors are active at any given time. For 
arbitrary N > 3, we derive the optimal matrices which min- 
imize the maximum condition number of all the submatrices 
of three columns. Surprisingly, a uniform distribution of the 
columns is not the optimal design for odd N > 7. 

Index Terms — matrix design, sensor network, source lo- 
calization and monitoring, condition number, singular value 

1. INTRODUCTION 

We consider the problem of designing sensing schemes to op- 
timize the worst-case estimation performance when only a 
subset of sensors are operational in sensor networks. Con- 
sider a set of N sensors which are used to estimate an M- 
dimensional signal, where N > M. In our problem, only 
K out of these N sensors operate at any instant of time. For 
example, to maximize the lifetime of a sensor network JT] [3] 
[9] HUE] Q3], at any single time instant, only K sensors are 
turned on to monitor the M-dimensional signal. If we assume 
that each time these K sensors are uniformly selected from 
the (^) possible subsets, on average the lifetime of the sensor 
network is extended by a factor of N/ K. As another example, 
in hostile environments such as battlefields, it is very com- 
mon that only a limited number of sensors, say K out of N, 
are able to survive and operate as designed. In these scenar- 
ios, while we only have a limited sensing resources at a single 
time instant, we wish to achieve the best estimation from lim- 
ited observations. It is thus useful to maximize the worst-case 
performance of the sensing system, no matter what set of sen- 
sors are used or survive. We thus study the design of sensing 
schemes that optimize worst-case performance. Before a for- 
mal mathematical formulation, we review two sensor network 



applications which relate singular values of certain matrices 
to estimation performance. 

1.1. Signal Estimation 

With x £ M M representing the signal, consider a sensing ma- 
trix A £ M. MxN . Each of the N sensors generates a real 
observation represented by an inner product between x and 
a column of A. Let KS C {1,2..., N}, with cardinality 
\KS\ = K, be the subset of sensors that are active at a given 
time. The measurement matrix of the active sensors is then 
consisting of the K columns of A indexed by 



pMxK 



A K s G 

KS. With noise w, the measurement y £ M K is 



y 



to, 



(1.1) 



Suppose the singular values of Aks are Cj. Then as long 
as Aks nas full row rank, the estimation error satisfies 
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To optimize the worst-case performance, we must design A to 
maximize the smallest singular value among all the („) pos- 
sible submatrices Aks- To make the problem meaningful, 
we assume that each column of A has unit £2 norm. When 
M = 2, this is equivalent to minimizing the maximum condi- 
tion number among all (^) submatrices Aks- 



1.2. Source Monitoring in the Plane 

A second motivating application for this paper is optimum 
sensor placement for source monitoring in M 2 , |[51-||8I. Mon- 
itoring is related to the notion of localization, where several 
sensors collaborate to locate a source, using some relative po- 
sition information. The latter could be distance, bearing, time 
of arrival, time difference of arrival or received signal strength 
(RSS). Monitoring assumes that a hazardous source has al- 
ready been located at some z £ M 2 , and a group of sensors 
at Xi £ M 2 monitor it by continuously estimating its position 
from a safe distance. Thus place sensors, i.e. choose 

Xi, so that the minimum eigenvalue of the Fisher Informa- 
tion Matrix (FIM) underlying the estimation problem is max- 
imized. This ensures that under continuous monitoring and 
Maximum Likelihood (ML) estimation, asymptotically, the 



mean-square error in estimating z, is minimized, l4l fj"5l [T6l . 
As z is at least roughly known, so also is the FIM. 

Consider (5] [TOl . where no sensor can be closer than D 
from the source. Each measures the RSS of the signal ema- 
nating from the source under log-normal shadowing, i.e. with 
known positive real scalars A and /3, the RSS Si at the i-th 
sensor obeys, for mutually independent Wi ~ Af (0, a 2 ): 



In ,s; — In A — ft In | \xi — z\ \ + Wi , 
The underlying FIM with iV-sensors is, Q 

— (xi - z)(xi - z) T 
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a 2 (In 10) : 
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(1.2) 



(1.3) 



The optimal sensor placement problem then becomes: Given, 
z G M 2 , and D > 0, find a;, G M 2 , i £ {1, • • • , N} so that the 
minimum eigenvalue of G is maximized, subject to: ||a^ — 
z\\ > D. Because of the denominator in (11.3b . the minimum 
eigenvalue of G is maximized only if for all i G {1, • • • , N}, 
\\xi — z\\ = D. Without loss of generality one can assume 
D = 1 and z = 0. Thus effectively one must maximize the 
minimum eigenvalue of 



E 



.1 jX ■ 



(1.4) 



subject to ||:z;i|| = 1. This is tantamount to minimizing the 
condition number of F as its trace is constrained to be N, 

Now suppose to prolong battery life, only a subset of sen- 
sors is activated at a given time, lfT2lfT4l . The logical problem 
to consider is then for some K, KS as defined above, and 



"KS 



E 

ieKS 



(1.5) 



to minimize the largest condition number of Fks, among all 
KS C {1, • ■ • , N}. With A KS having columns x it i G KS, 
we have Fks = ^ks^ks^ anc ^ a s i mnal " setting of Section 
11.11 We observe, that the minimum K needed for source mon- 
itoring is three, motivating the rest of this paper where K = 3 
is considered. In particular RSS provides a distance estimate. 
Distances from three non-collinear sources are necessary to 
localize, ifTTl . This scenario also applies to the case where 
only three sensors survive hostilities. 

The rest of this paper is organized as follows. Section |2] 
gives a precise mathematical formulation. Section |3]provides 
a formula for the minimum condition number of submatrices 
when M = 2. Section |4] characterizes optimal solutions all 
for M = 2, K — 3 and arbitrary N > 3. Section|5]presents 
simulations. 

2. PROBLEM FORMULATION 

Let M < N be positive integers and A — [a%, a%, O/v], 
where a % G R M obey ||ai|| 2 = 1 for 1 < i < N. Let KS C 



{1, 2, N} be a subset with cardinality \KS\ = K. Now, 

Aks £ R MxK is the submatrix Aks — [aiu^i i a ii<] 

with columns indices ij, 1 < j < K, from the set KS. Then 
our optimal design problem for the parameter set (M, N, K) 
is: 



max < mm 

A G K M x N with unit-normed columns ^ifSC{l,2,.. 



Mks) 



For M — 2, this is equivalent to minimizing the condition 
number: 



"with unit-normed columns \kSC{1,2,...,N} 0~ m i n (Axs) 

Note the similarity between this problem and the prob- 
lem of designing compressive sensing matrices [2] satisfying 
the restricted isometry property (RIP), which also requires the 
condition numbers for the submatrices be small. As opposed 
to the design of compressive sensing matrices satisfying RIP 
0, in our problem, the submatrices Aks are wide rather than 
tall. The motivating applications are also different from com- 
pressive sensing. 

As noted earlier, motivated in part by 2-dimensional 
source monitoring with the minimum number of sensors i.e. 
K = 3, we restrict attention to the case of K = 3 and 
M = 2, where closed form expressions are possible and sur- 
prising conclusions, that may illuminate the problem solution 
for higher values of K and M, are obtained. 

3. DERIVATION OF THE CONDITION NUMBER 

FOR M = 2 

The condition number of Aks — AksA ks is given by 
max\ M i =1 (T] T AKsri) 



k(Aks) 



\m^ =1 (rj T A K sr]) 



(3.1) 



Since the columns of A are unit-normed, we can represent 

A = [cii, a,2, djv] with 



COS* 



y 



(3.2) 



for 1 < i < N, where 6*; G [0,7r) (we do notice shifting 0i 
by 7r will not change the condition number of any submatrix). 
Since ||?7||2 = 1 we can choose 77 = ( cos a sin a ) . 
Thus 

K 1 K 

V T A K sV = T + t E cos ( 2 ( a _ h)) = J («)- 



Let us define 

J(a) 



K 1 



A" 



5^008(2(0-^)). (3.3) 



Then the minimum (maximum) eigenvalue of Aks is achieved 
when J' (a) = and J" (a) > (<)0. With 



K 



K 



7 = (E sin(2^ )) 2 + (E cos ( 2 ^i )) 2 ^ °> 

3=1 3=1 

at a minimum or maximum, a satisfies 

K 

cos(2a) =E c °s( 2 ^-)/7 



and 



Thus, 



3=1 



A" 



4. OPTIMAL PLACEMENT 

We now consider solutions for M = 2, K = 3 and different 
values of AT. 

4.1. X = 3, TV is an even number 

For even-numbered N, the optimal design is given as below. 
Theorem 4.1 If K = 3 anc/ AT is an even number, then the 



sm(2a) = 5^sin(20 jj )/7. 

3=1 



se? of angles (a) 0, 



_ 27r(i-l) 
— JV ' 



_ 27r(i-l) 

AT 



mod 7r, 1 < i < A 7 ", or ffcj 



1 < j < A 7 , minimizes the maximum condition 



K 



K 



J(<*) = ~^+\ E cos ( 2 «) cos(26» l3 )+i E sin(2a) sin(2^ ) 

(3.4) 



3=1 



3 = 1 



Combining the optimizing a and (I3.4K we have 

■/(a) = f + 

1 EjLi Ef=i (cos(2^ ) cos(2^ ) + sin^, ) sin(20i .)) 



(E^ 1 sin(2(0 l ,))) 2 + (Er=iCos(20 li )) 2 

On simplification, the maximum and minimum eigenval- 
ues of Aks are given by 



K 



K 1 

J[. a max) — g ' 2 



\ 



f + EE cos2(9 ( , -9 (J ), 



K K 



3 = 1 Z=J + 1 



(3.5) 



and 



T( \ - K _ 1 



\ 



A" 



T+E E cos2(^-0,.). 



3=i ;=i+i 



(3.6) 

respectively. Thus minimizing the condition number of Aks 
for a given set of indices {ii, i%, .., %k] is the same as (the 
equation inside the square root is always nonnegative) 

K K 

a min fl E E cob 2^, (3.7) 

With A'S* C {1, 2, A 7 }, the optimal sensing matrix de- 
sign problem for M = 2 can be reformulated as, 

K K 

min max > > cos2(6L — 0< ). 

6i,...,6 N K-S={ii,ta,...ijf}r-f 

3 = 1 '=3 + 1 

In the following sections, we will derive the optimal de- 
sign for AT = 3, which has important applications in location 
monitoring in sensor networks. 



number among all sub-matrices with K columns. 

Observe, (a) actually aligns pairs of angles together (see Fig 
Q]) and is not useful for source monitoring where at least three 
distinct sensor locations are necessary, [17|. On the other 
hand (b) leads to distinct locations by separating adjacent sen- 
sors 2tt/N radians apart. 



4.2. K = 3, N = 3 or 5 

These stand apart from other odd N values: 

Theorem 4.2 Let K = 3 and N — 3 or 5. Then the set of 
angles 9i = ™ ^ , 1 < i < N, minimizes the maximum con- 
dition number among all sub-matrices with K = 3 columns. 
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Fig. 1: Illustration of angle arrangements 0j's for N = 6, 7 
and 5 respectively, using the 3 rows of figures from top to bot- 
tom. The left figures represent the angle (0;) for the columns 
of sensing matrices. Right figures are doubling those angles 
(20,;) as in the objective function in ( 13.71 ). 



4.3. K = 3, N > 7 is an Odd Number 

One might think that the uniform distributed design is optimal 
for N > 7. However, this is not true from the following 
theorem. Instead, the optimal design is to eliminate one angle 
from the optimal design for (N + 1). 

Theorem 4.3 If K = 3 and N > 7 is an odd number, then 
0» = 2 ^n+i^ m od 7r, 1 < i < N, minimizes the maxi- 
mum condition number among all sub-matrices with K = 3 
columns. 

5. SIMULATION RESULTS 

We now present simulation results. 



2 



% 1.4 



















— Uniform angular separation in [0,ti) 




— Proposed solution 
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Fig. 3: Worst case estimation error versus the number of 
columns in the sensing matrix. 



5.1. Worst Case Condition Number vs N 




Number of Columns/Sensors 



Fig. 2: Worst case condition number versus N 

We compare the maximum condition number among all 
the possible 2x3 submatrices in three different cases shown 
in FigfJ] The cases are, (i) when successive sensors are placed 
in a semicircle n/N apart, namely 9i = 0, Jjj, 7r ^~ 1 - ) , (ii) 

they are placed 2n/N apart, namely 0, = 0, 4?, 27r( -^~ 1 - ) , 
and (iii) they are placed in a manner specified by our theo- 
rems. That the performance of (ii) matches (iii) for even N 
conforms with earlier observations. 

5.2. Worst Mean Square Signal Estimation Error vs N 

Consider the setting of SectionQTT] We compare in Fig. |3]the 
mean square error (MSE) for worst-case submatrices yielded 
by (i) above with that yielded by the postulated optimum for 
sensors ranging in number from 3 to 15. The signal x in (II . lb 
is [9, 9] T . The noise in each measurement is TV ~ (0,1). 
For each value N, the estimation error \\x — x\\ 2 for worst- 
case submatrices was averaged over 2000 instances. Again 
the predicted optimal placement is superior. 
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Fig. 4: Mean square error(dB) in the source location estimate 
when the worst performing subset of sensors are active versus 
the Signal to Noise Ratio(dB). 

5.3. Monitoring Error vs SNR 

Fig. |4] compares the ML estimation of a source at the origin 
with N = 10, from RSS under log-normal shadowing in the 
case where the sensors are placed as in (i) against optimal 
placement. The latter's superiority is evident. 

6. CONCLUSION AND FUTURE WORK 

We propose the problem designing optimal M x N (M < 
N) sensing matrices which minimize the maximum condition 
number of all the submatrices of K columns. Such matrices 
minimize the worst-case estimation errors when only K sen- 
sors out of N sensors are available for sensing at a given time. 
When M — 2 and K = 3, for an arbitrary N > 3, we derive 
the optimal matrices which minimize the maximum condition 
number of all the submatrices of K columns. It is interesting 
that minimizing the maximum coherence between columns 
does not always guarantee minimizing the maximum condi- 
tion number. 
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